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ABSTRACT 


Hie Lockheed Martin Aeronautics Company has been awarded several programs to modernize the aging C-5 military transport fleet. 
In order to ensure its continuation amidst budget cuts, it was important to engage the decision makers by providing an environment to 
analyze the benefits of the modernization program. This paper describes an interface that allows the user to change inputs such as 
the scenario airfields, take-off conditions, and reliability characteristics. The underlying logistics surrogate model was generated using 
data from a discrete-event simulation. Various visualizations, such as intercontinental flight paths illustrated in 3D. have been created 
to aid the user in analyzing scenarios and performing comparative assessments for various output logistics metrics. The capability to 
rapidly and dynamically evaluate and compare scenarios was developed enabling real-time strategy exploration and trade-offs. 


NOMENCLATURE 

AMP Avionics Modernization Program 

APOD Aerial Port of Debarkation 

APOE Aerial Port of Embarkation 

CDF Cumulative Distribution Function 

CONUS Continental United States 

DES Discrete Event Simulation 

MOG Maximum on Ground 

M&S Modeling and Simulation 

NN Neural Network 

PDF Probability Density Function 

RERP Reliability Enhancement and 

Re-Engining Program 
SAC Strategic Airlift Comparison 

SME Subject Matter Expert 

1 INTRODUCTION 

The C-5 Galaxy has been an integral 
logistics component of the US military since 
its introduction in 1970. The C-5 is the 
largest transport aircraft, and it is the only 
heavy-cargo aircraft capable of transporting 
the military's largest and heaviest combat 
equipment including tanks, helicopters, and 
scissor bridges [1]. Its unique configuration 
also allows for rapid loading and off-loading 


of equipment and cargo [2, 3]. The C-5 has 
served an important role in strategic airiift 
missions and force projection. 

Two modernization programs were initiated 
to improve the performance of the C-5 
aircraft. The Air Force’s C-5 Avionics 
Modernization Program (AMP) modernizes 
the aircraft with a modern digital equipment 
or "glass cockpit”, an all-weather flight 
control system, and Global Air Traffic 
Management, navigation and safety 
equipment. The C-5 Reliability 
Enhancement and Re-engining Program 
(RERP) replaces the propulsion system and 
modifies the mechanical, hydraulic, avionics, 
fuel, and landing gear systems [4], These 
two programs aim to improve the reliability 
and availability of the C-5 fleet in the coming 
years. 

The two programs have faced scrutiny and 
changes due to delays and cost growth. 

After a legislative review, the new contract 
for the RERP allows for only 52 of the 1 1 1 
C-5 aircraft to receive the modifications [5], 
Lockheed Martin Company, which has won 
both contracts, has made efforts to 
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emphasize the need to keep the programs in 
place and to promote the need to upgrade 
the remaining fieet. 

One such effort described in this paper is the 
development of the Strategic Airlift 
Comparison (SAC) tool. The SAC tool 
shows the logistical advantage of having a 
C-5M fleet over a corresponding C-5A fleet. 
The tool leverages modeling and simulation 
(M&S) to present a convincing argument in 
support of the modifications in a format that 
can be easily understood by decision 
makers such as government officials and 
military officers who may need additional 
support for their decision making process. 

The paper begins with the development of 
the M&S environment to support the 
evaluation and decision making process of 
the C-5 modernization programs. A 
discrete-event simulation (DES) was created 
to generate the data for metrics including 
time to close a specific mission scenario and 
fuel consumption. The second half of the 
paper describes the interface which allows 
the user to display and manipulate the data 
in order to make comparisons between the 
different platforms. Different types of 
visualizations are also presented and 
discussed. The paper concludes with 
several examples of how this tool can be 
used to make comparisons. 

2 DECISION MAKING AND M&S 

Trends in cost overruns in defense 
acquisition have put accountability as a 
priority. Acquisition decisions must be 
traceable and should be backed by sound 
technical analysis. Since, decision makers 
often require insight into the technical details 
of the problem, they typically consult subject 
matter experts (SME). However, even when 
the SMEs are included in the discussions, 
there are situations when the experience of 
the SMEs is not adequate to answer 
speculative questions and 'what if 
scenarios”. 


For these questions, M&S can provide 
valuable insight into the problem at 
affordable costs and within a limited time 
frame [6]. 

2.1 Discrete Event Simulation 

A discrete -event simulation (DES) was 
created to simulate the performance of a C-5 
fleet. The DES models a system as a series 
of events, and this is well-suited for a 
logistics problem. For example, an aircraft 
arriving at an airport is an event, and each of 
these actions can be modeled per aircraft. 
Then a group of aircraft can be simulated 
together to gain insight on how an entire 
fleet would perform. 

Several DES programs were examined 
including ExtendSim, Process Simulator, 
SimEvents and SimPy. ExtendSim and 
Process Simulator are commercial DES 
packages, and the users graphically arrange 
the process elements and the linkages [7, 8]. 
Process Simulator also requires Microsoft 
Visio to run. SimEvents is a DES package 
for MATLAB and also uses a graphical 
interface [9], Simulation in Python (SimPy) is 
an object-oriented DES package written in 
the Python programming language [10], It is 
open source and executes quickly; however, 
the set up and the outputs of the simulation 
are not graphical. For this project, SimPy 
was selected for its flexibility, fast run time, 
and availability. 

The selection of SimPy proved to be prudent 
when the simulation runs had to be scaled 
up and distributed over several workstations. 
The open source nature allowed the team to 
run cases on different machines without 
worrying about licensing issues. 

Furthermore, multithreading was enabled 
using the Parallel Python package, allowing 
the program to use all processor cores. 

2.2 Simluation Set Up 

The simulation captures a simple logistics 
scenario of transporting cargo from the 
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Figure 1. Simulation Flow Block Diagram 


aerial port of embarkation (APOE) to the 
aerial port of disembarkation (APOD). The 
simulation flow is outlined in Fig. 1 . 

There are four different routing options 
available which are the following: 1) direct 
flight between APOE and APOD, 2} en route 
location for forward flight with direct return 
flight, 3) same en route location for forward 
and return flights, and, 4) two different en 
route location for forward and return flights. 

The simulation begins with all of the aircraft 
at the APOE, and it ends when the last 
aircraft returns back to the APOE. At each 
airfield, a maximum on ground (MOG) 
constraint limits the number of aircraft that 
can be serviced at any given time. Thus, if 
an airfield has a MOG of three and has five 
aircraft on site, two of the aircraft would have 
to wait on the side of the tarmac until a 
station opens up. 

In the service station, the aircraft waits for a 
set amount of time for the scheduled activity 
at the airfield, such as loading cargo and 
refueling. Time is dependent on the type of 
aircraft and activity. The ground times listed 
in the AFPAM1 0-1403 were used [3], 


After the servicing is completed, a random 
probabilistic algorithm is used to determine if 
the aircraft had suffered any minor failures 
during its previous flight and how long it 
would take to repair it. All failures are 
assumed to take no more than 72 hours, and 
the repair time of each failure is determined 
based off of a pre-defined random 
distribution. The aircraft then prepares for 
take-off, and only one aircraft can occupy the 
runway. If there are multiple aircraft ready to 
take-off, they must wait for their turn. 

The flight times are calculated based on the 
aircraft’s block speed. Within the simulation, 
the same type of aircraft will fly the 
equivalent distance in the same amount of 
time. The distances have been calculated 
using the great circle distance formula, and 
the variability of flight times due to weather 
and other factors were not incorporated into 
this simulation. 

Utilization is a metric of how hard the crew 
works, and this is typically calculated as an 
average amount of hours flown per day. For 
the simulation, the utilization was calculated 
as the ratio of the total flight time, from 
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leaving the APOE to returning back to the 
APOE, and the total amount of time spent 
since leaving the APOE. A cap of 1 6 hours 
was placed, and if any aircraft exceeded this 
at the end of its mission, it was grounded 
before returning to service at the APOE. 

2.3 Model Inupts 

The DES does not require the physics of the 
problem, such as the amount of cargo and 
the amount of fuel consumed. Much of this 
information was calculated beforehand, and 
the model was abstracted out, reducing the 
number of inputs and increasing its 
extensibility to other aircraft. The input 
variables into the DES are listed in Table 1 . 


Table 1. SimPy Model Input Variables 


SimPy Inputs 

Min 

Max 

Type of Aircraft 

0 

1 

Fleet Size 

1 

70 

Number of Flights 

1 

1000 

Routing 

1 

4 

Flight Time: Leg 1 

30 

1200 

Flight Time: Leg 2 

30 

1200 

Flight Time: Leg 3 

30 

1200 

Flight Time: Leg 4 

30 

1200 

Repair Prob: 0 to 4 hrs 

0 

1 

Repair Prob: 4 to 12 hrs 

0 

1 

Repair Prob: 12 to 24 hrs 

0 

1 

Break Rate 

0.01 

0.6 

MOG: APOE 

1 

15 

MOG: APOD 

1 

15 

MOG: En Route 1 

1 

15 

MOG: En Route 2 

1 

15 


2.4 Model Limitations 

The DES model currently supports the C-5 
and the C-1 7. Adding other types of aircraft 
is possible as long as the ground servicing 
times are available. However, this only 
pertains to running the model itself, and the 
payload-range curve, block speed and fuel 
burn are needed to be useable with the 
interface. 


Another current limitation is that the model 
has only four options for routes. In reality, 
there may be more airfields involved in each 
mission. For example, refueling usually does 
not occur at the APOD if it is in a hostile 
location; a recovery airfield close to and 
safer than the APOD would be involved. 
Including more airfields makes the routing 
more complicated and increases the number 
of variables. 

There have also been discussions about 
extending capability to hybrid fleets where 
different types of aircraft would fly different 
legs of the mission. For example, the C-5 
could fly transatlantic flights, while the C-1 7 
could fly the shorter legs to different airfields 
in the region. 

2.5 Simulation Runs 

Over 50,000 cases were used to populate 
the design space. A combination of central 
composite and space filling designs were 
used to generate the cases to run. Each 
case was repeated 1000 times in order to 
generate the distribution due to the variability 
of failure events and repair times. The runs 
were allocated across several workstations. 

Each case of a 1000 runs took anywhere 
from a few seconds to over 30 seconds 
depending on the input parameters, and the 
final set of data took a few days to run 
across several machines. 

2.6 Surrogate Modeling 

Surrogate models of the DES model were 
created to avoid carrying the large data set 
and to enable interactivity with the of the 
interface. 

The design space was nonlinear, and the 
time to close increased dramatically as the 
fleet size decreased to one aircraft. A neural 
network (NN) model was fitted to the data, 
but the NN model outputs at the edges had 
poor fits due to the nonlinearity of the data. 
To resolve this issue, a separate NN was 
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Figure 2. Strategic Airlift Comparison Tool Layout 


fitted to the data for low number of flights and 
small fleet sizes. The two NN models were 
patched together using linear interpolation. 

3 DECISION SUPPORT INTERFACE 

3.1 Interface Tool Layout 

The decision support interface is developed 
within JMP, one of the statistical software 
packages produced by the SAS institute [11]. 
The layout of the tool is arranged with inputs 
at the left or top and outputs to the right or at 
the bottom. Inputs are entered or selected in 
four outline boxes: Mission Scenario Inputs, 
Payload-Rage Curve, Allocated Fleet Size, 
and Aircraft Repair Rates. Output outline 
boxes include Global Reach with Airfield 
Location, Number of Days to Close, 

Required Allocated Fleet Size and Logistics 
Metrics. The layout is adjustable for various 
screen sizes and resolutions and is shown 
for a wide screen format in Fig. 2. Some of 
these various outline boxes are described 
briefly in the following sections. In addition, a 
number of the outline boxes contain 
advanced visualizations that assist the user 
in understanding specific scenarios, or 
comparing between aircraft platforms. 

3.2 Mission Scenario Inputs 

Application and analysis of the tool will 
typically begin within the Mission Scenario 


Input outline box at the top right in Fig. 2. 
Mission scenarios are defined by three 
essential inputs, namely, the APOE, the 
APOD and a given mission payload. The 
other input parameters are defaulted to initial 
values, but can be adjusted. For example, 
the type of payload is adjustable to five 
different payload types typically transported 
on C-5 aircraft. When selecting a payload 
type (other than the default custom payload 
option), the loading curve will adjust 
accordingly and will represent the actual 
average payload per flight based on 
constraints such as temperature, airfield 
length, cubing-out conditions, etc. 

Since some missions will require an en route 
location for refueling, or for increasing 
average payloads per mission, the various 
options for adding such an airfield are placed 
below the APOE and APOD selection boxes. 
Three options for en route locations include: 
Outbound, En Route Retrograde, and Direct 
Retrograde and is provided for the 
respective situations of refueling on the way 
to the APOD, on the way back to the APOE, 
or flying direct back to the APOE without 
refueling. In addition to selecting the en 
route locations, comparisons between the 
C-5A and C-5M platforms are possible by 
having one or both stop over in different 
combinations. This allows the user to quickly 
perform what-if comparisons and investigate 
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the advantages and disadvantages of 
stopping to refuel at different locations, for 
different distances, among the various 
constraints. 

The two other tabs within this outline box, 

(i.e. Assumptions and Users Too! Box) allow 
access to additional settings and constraints 
for the airfields and visualizations 
respectively. Within the Assumptions tab, 
users can modify the MOG for each airfield 
and within the Users Tools Box, the layout 
can be adjusted, colors can be changed and 
example Bubble Plots can be created which 
are described later. 

3.3 Payload-Range Curve, Fleet Size 
and Repair Rates 

The payload-range (PR) curve displayed 
corresponds with the selected APOE, by 
making use of the elevation and airfield 
length data at that particular location. 
Furthermore, in calculating the PR curve the 
ambient temperature at the APOE can be 
set from 5 to 40 °C making the curve 
dynamic for this temperature range. Other 
settings can account for variable reserve 
fuels and minimum payload per flight 
requirements set by toggling the Dynamic 
PR Controls check box. 

The fleet size for each of the C-5 platforms is 
entered using an interactive bar chart within 
the Allocated Fleet Size outline box. The 
values themselves are both linked and 
constrained in that there are only 59 C-5As 
currently available, and only 1 1 1 C-5Ms 
possible for allocation if all 59 C-5As, and 
the other 52 C-5B and Cs were modified. 
This useful technique keeps scenarios and 
comparisons as defined by the user within 
the realm of possibility. 

The Aircraft Repair Rates outline box allows 
the user to adjust reliability parameters for 
the aircraft. First, break rates, defined as the 
percentage of flights that require repair {and 
therefore a delay) for each leg of the mission 
are set for each platform in a range from 0 to 


60%. Next the probability for each of the four 
categories of repair or delay times are set. 
The percentage of time that repairs will fall 
into one of the four delay time categories, 

(i.e. 0-4hrs, 4-12hrs, 12-24hrs, and 
24-72hrs) are positioned by the user 
dragging the marker for each category's bar, 
or by adjusting the cumulative distribution 
function, which are internally linked. 

The average repair time for the given 
distribution is indicated at the bottom and is 
used to generally compare a platform's 
recoverability. For example, a piatform’s 
lower average repair time, compared to the 
other will be more recoverable, 
characterized by low repair times, even with 
a higher break rate. The overall reliability is 
thus a function of the repair times for each 
category and the break rate which are used 
within and surrogate model of the the 
discrete-event simulation. 

3.4 Number of Days to Close and 
Logistic Metric Outputs 

Although there are two types of missions 
selectable within the scenario inputs outline 
box, namely, “Overseas Contingency 
Support” and “Crisis Deployment”, the user 
will be more often interested in the latter. 
Thus, the output metric of interest is the 
number of days to close a mission or the 
time required to deliver the specified total 
mission payload to the APOD. The mean, 
standard deviation and shape of the time to 
close distribution is presented in the table 
and graph within the Number of Days to 
Close outline box. These output metrics are 
updated in real-time by changing any of the 
other input parameters discussed previously. 
Any modification to the scenario, fleet size, 
or reliability parameters will automatically 
rerun a surrogate model to recreate the time 
to close distribution and other output logistic 
metrics. 

Other logistic metrics, including cost and 
gallons of fuel, flight hours, and utilization 
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are traded against the time to close output 
metric. Clearly, closing the mission as soon 
as possible is desirable, but the cost of fuel 
and flight hours (i.e. a representation of 
human resources required) may be too. 
Similarly, the total mission payload could be 
delivered in a very short amount of time by 
increasing the fleet size, but this too may be 
impractical or even impossible. Thus, the 
trade-offs and sensitivities between output 
metrics, but also between inputs and 
outputs, becomes examinable. 

3.5 Airfield Selection and Filtering 
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Figure 3. Examples of Airfield Filtering and Color- 
ing Schemes 

The visualization of the user-defined 
scenario is automatically displayed on the 
airfield locations map. However, before the 
APOE and other scenario airfields are 
selected, the map also allows the user to 
filter, down select and investigate airfield 
locations and attributes. Two filtering 
methods are provided as defaults: the 
required airfield length and required airfield 
width, and are set to remove or hide all 
airfields that do not meet those 
requirements. 


Further investigation can be performed by 
right clicking on any airfield location and 
exploring the airfield attributes. Other useful 
coloring schemes, such as coloring by 
elevation or country, are available, along with 
the JMP Data Filter which can be 
implemented to add constraints or other 
filtering options (See Fig. 3). The coloring 
“By Distance From APOE" and “By 
Comparison" is only active after selecting an 
APOE. This latter option allows comparisons 
between the different platforms for reachable 
airfields from the selected APOE, and can 
quickly illustrate the capability gap of the 
C-5Ms over the C-5As for equal payloads 
and take-off conditions. 

3.6 Advanced Visualizations and 
Analyses 

A number of visualizations were developed 
to answer concerns identified during various 
test phases of the tool’s development. These 
visualizations aid decision makers in 
understanding the assumptions and details 
of the scenario, and clarify certain model 
characteristics and outputs. 



Figure 4. Visualization of 3D Flight Paths 

One of most commonly expressed 
limitations, for example, was the potential for 
users to be confused with the flight path 
representation on the 2D map. Developers 
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of the tool decided that a simple node and 
edge diagram for the flight paths {with only 
straight edges) would be most clear in a 
graphical representation of the mission 
scenario. The disadvantage of such a 
decision is the possible confusion of the 
actual flight path taken by aircraft since the 
true path on a flat earth model will be curved 
along the great circle distance between two 
points. To avoid this possibility, the actual 
path taken between two airfields is redrawn 
onto a 3D earth model as shown in Fig. 4. 

The advantages of this visualization include 
mission leg distances that are relatively 
consistent with each other (not always the 
case for projections onto a 2D map) and the 
rapid identification of airspace violations 
against countries or other political 
constraints. Enhancements to this 
visualization will include analysis of how the 
flight path will circle around a particular 
nation, which will not allow C-5 aircraft from 
entering its airspace and the resultant 
impact on the output and logistic metrics. 



Figure 5. Bubble Plot Animation Showing the 
Movement of Payload 

To assist decision makers in understanding 
the delivery of the mission payload over time 
and how aircraft are delayed and interact 
with each other at the various airfields, a 
Bubble Plot representation of the mission 
can be executed from the Users Tool Box tab 
in the Mission Scenario Inputs outline box 
(See Fig. 5), 

The location of all aircraft and the current 
location of the payload (i.e. at the APOE, in 


flight or at the APOD), with relative time 
stamps can be explored at all times during 
the mission. Furthermore, comparisons in 
time of different scenarios, fleet sizes, etc. 
can be performed with more than one 
Bubble Plot. To enable this comparison, the 
Bubble Plot is simply executed again after a 
change in the mission scenario (such as a 
new en route location), and then setting the 
speed and time stamp values within the plots 
consistently. Exploring the delivered payload 
overtime can be helpful in assisting decision 
makers to identify the impact of parameter 
changes on time to close or other metrics 
when the scenario is changed at various 
times in the mission. 



Figure 6. 3D Loading Volume Representation (blue: 
C-5A, green: C-5M) 

Another visualization, currently in the 
experimental phase of development, is a 3D 
representation of the loading volume of the 
two platforms (See Fig. 6). When adjusting 
the temperature of the PR curve or changing 
the location of the APOE, the maximum 
possible payload weight will fluctuate in 
order to satisfy the constraint of the mission 
scenario and the platform itself. To compare 
the cargo transporting holding capabilities of 
the C-5M over the C-5A, a volume 
representing the percentage of the maximum 
payload weight is projected within the cargo 
bay of the aircraft. These volumes represent 
the weight percentage and currently not the 
actual space used by any particular payload 
type. Potential enhancements to this 
visualization include detailed cargo 
characterization and how loading schemes 
affect the logistic metrics and other 
performance and aerodynamic metrics such 
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as trim angles and stability points. Thus, 
future analyses may allow the decision 
maker to trade not only programmatic and 
mission parameters with high level logistic 
metrics, but potentially with lower level 
performance and operational metrics as well. 

4 DISCUSSION 

Using the input parameters and the DES 
surrogate model, trade-offs and analyses 
can become interactive and provide more 
insight. For example, suppose that a 
decision maker wants to compare the 
performance of the C-5A and C-5M for a 
particular cargo delivery mission. In this 
scenario, the C-5A will be making a stopover 
at an en route location, while the C-5M will 
fly directly to and from the APOD. In terms of 
time to close, the C-5A may complete the 
mission faster, but there is an additional cost 
for operating a refueling base overseas. For 
the decision maker, the cost savings of the 
C-5M may be the better option despite the 
longer time to close. In another scenario, 
there may be a hard requirement on time to 
close, and the fleet size can be changed to 
satisfy it. Furthermore, the two platforms will 
fly the same route so no overseas bases are 
needed. In this case, time is saved at the 
expense of maintaining a larger fleet at 
home. 

The addition of changeable break rates and 
repair rates provides insight into how 
reliability affects the fleet size required to 
complete a mission. For many scenarios, 
reducing the break rates can decrease the 
average time to close and decrease the 
distribution. Likewise, fleet size and repair 
rates can be traded against the other logistic 
parameters. Utilization may be higher with 
more reliable aircraft, but lower with larger 
fleet sizes. Decision makers can also use 
the tool to investigate what targets for 
improved reliability are required to increase 
a particular capability. For example, what 
level of break rate must be reached to 
decrease the time to close by 10%? 


Total cost of fuel can also be traded with a 
different en route location. An en route 
location with a higher MOG may be more 
"out of the way," but it may be less risky for 
bottle necks if repairs are necessary. Thus, 
although the cost of fuel will be greater, the 
time to close will likely be lower by using the 
base with a higher MOG constraint. 

Lastly, all of these outputs and parameters 
are dependent on the PR curve and on the 
underlying assumptions of required reserve 
fuel and temperature. At some 
temperatures, the difference in time to close 
for the C-5A and C-5M is significant and 
favors the re-engined C-5M, but at lower 
temperatures the capability gap isn't quite as 
significant. Reserve fuel is also available for 
adjustment. This parameter (similar to the 
risk of low MOG airfields) allows the decision 
maker to apply different levels of risk to the 
scenario by exploring the impact of reducing 
the required reserve fuel on metrics such as 
time to close and fuel cost. 

5 CONCLUSION 

An interactive tool was developed to provide 
decision makers access to simulation 
models and data for improved analysis, 
mission planning and aircraft platform 
comparisons. Surrogate modeling was a key 
component for rapidly and dynamically 
performing trades between various logistic 
metrics including cost, risk and time. The 
surrogate model was created from 
discrete-event simulations of military cargo 
missions delivering payloads to airfields 
around the world, across a range of input 
attributes and parameters. Sensitivity 
analyses, what-if games and comparisons 
between aircraft platforms are enabled in 
real-time through a combination of dynamic 
visualizations, adjustable assumptions, and 
surrogate modeling techniques. 
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Legacy of the C®5 Galaxy 


Congressional Review 
due to cost overruns 

31C-5A Re-winging 50C-5B AMP RERP C-5Msets41 
manufactured of C-5A manufactured Initiated Initiated new records 
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C-5M program addresses the low reliability problem 
Is this enough to satisfy the future strategic airlift need? 


❖ Modeling Questions 

What is the impact of the modification program to the total airlift capability? 

■ How does a C-5A/B fleet compare with a C-5M fleet? 

♦> Decision Making Questions 

How do we bring the knowledge of the Subject Matter Experts to the Decision Makers? 
How can we couple simulation and data analysis with decision making? 

How can we make data exploration and analysis interactive and insightful? 

What techniques are available to enable various perspectives from different users or 
decision makers ? 

- How can these perspectives be synthesized to help make a more evidence-based 
decision? 
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nulation 


Discrete Event Simulation Model 

■ Logistics Problem 

■ Very procedural 

Sampled available DES packages 






Process 

b I m u I a t o r 

<2010 


^Sim Events 





ng Options 


Routing Options; 

Route 1 - Direct, no en route 

Route 2 - 1 en route 

Route 3 - 1 en route, direct back 

Route 4 - 2 en route 


htipJAjp1oad.w!km0dia\OTE 
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du res 






d Surrogate Models 


Design of Experiments 

■ Central Composite and Space 
Filling 

« Approx. 50,000 cases 
« 1 ,000 runs per case 

Create surrogate models to 
enable easy interaction with the 
data 

Fitting Neural Networks 

Peak at low fleet size and high 
number of flights causes high 
errors at other extremes of the 
region 

Patched 2 NN - one covering the 
entire region, one for the corner 


Number of Flights 


Fleet siie 
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Visualizations and SAC Tool Demo 



SAC Tool Layout and Analyses 



Repair Rates 
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Debarkation (APOD): ^ ALEXANDRIA MTL2 
APOD EleoraliDn [ft): -5.6 
APOD Runway Length [ft): 7221 
APOD MQ&: ID 

3 


Aerial Port of Embarkation (APOE), 
Aerial Port of Debarkation (APOD) and 
En Route locations selectable from 
more than 36,000 airfields 


Distance from APOE to APOD (m): 5l6l 


0 En Raule OiStbDund? 
ground Refuel En Rome: v IN GUEZZAM 
Dislancs from APOE to En Route (nm): 451 i 
Dtttanca from En Route to APOD (nm): t9E6 
C.5A O No C 5M © No 
© Yes Q Yes 

□ Direct RflUogrode? 

□ En Route Retrograde? 


o 



■ Unspecified APOD user-defined 
parameters 

■ Adjustable MOG for APOD 
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❖ Various Selectable 
Payload types 

Pallets 

■ Stryker Brigade Combat 
Team 

■ Heavy Brigade Combat 
Team 

■ Infantry 

■ 82 nd Air Borne 

■ Custom Payloads 

❖ Cubing-out conditions applied 
through average payload per 
flight curves 


Ty pe of Mission and Payload 
O Overseas Contingency Support 
® Crisis Deployment 


Setect Payload Type: 

Pallets (3500 lbs) 

Heavy Brigade Combat Team 
Infantry 
82rtd Air Borne 
Custom Payload 
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Dynamic Payload-Range Curve 

■ Comparisons between platforms or investigations in isolation 
Interactive payload slider bars and operational point 

■ Curves for multiple temperatures 

■ Reachable airfields based on payload-range curve 



t Size and Reliability 


Fleet Size Comparison 

Dynamic bar chart 

■ Linked to actual number of C~ 
5A and C-5Ms 

Aircraft Reliability Comparisons 
Repair Rates 
Break Rates 

Interactive Probability Density 
Functions (PDF) and 
Cumulative Distribution 
Functions (CDF) for time to 
repair 

Adjustable break rates for each 
platform 


Alio crated Fleet Size 




AQ GO 
Fleet Size 


Aircraft Rep air Rates 


[ fljMCt fts Percent WS ] 

C-5A: 

17 

f r. „ i O Labels Off 

C-5H: 

IDS 

1 RjWi* frMfc P,4t£f I 
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EE 


fach and Airfield Down Selection 


Filtering of Airfields by 

■ Distance from APOE 

■ Airfield Length 

■ Airfield Width 

Visualization and Coloring by 

■ Country 
Elevation 

Distance from APOE 


Global Reach 


OiJitnc* frflrfi APOE c«n] |6023 1 bstor o By Crtnpariswi 


Required Airfield Length fl)- 

— o — 

Required Airfield Width (ty: >42 
2 

* * Airfield Locations 


O Sr Frem APOE 
O By Elevation 
O By Gwurtry 

© 0y Airfield Name 





;s Metrics 


♦5 Trade-offs between logistic 
metrics 

■ Number of Days to Close 

■ Cost/Gallons of Fuel 

■ Flight Hours 

■ Utilization 

❖ Discrete-time event surrogate 
model allows rapid trade-off 
with input parameters as well 


Number of Days to Close 

A'C Eri Porte Told i Faytaad 

Platform Available- Mean: Sld-dev Required: Fa yload/Frighl (lbs) 

C-SM 12 13.78 4.22 No 143233 19790000 

C-5A 16 39-1 6.46 m 109561 


C-5M C-5A 



Day* 



Logistics Metrics 
T Cost of Fuel 

Price of Fuel CVgallan'): 2.23 


Flight Hours 


9 Flight Hours 



T Gallons of Fuel 



0 ID 20 JO 50 60 ?0 


t — r- 

90 


Gallons (millions) 


T Utilization 



Utilisation (avg. 
hours used per day) 
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Additional Logistic Visualizations 


❖ 3D Cargo Loading Comparisons 

❖ 3D Flights Paths 

Used for flight path analysis and airspace 
constraints 

❖ Dynamic Bubble Plot for Resource 
Distribution Analysis 

■ Provides time stamp information where 
assets and payload are located 
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ements and Conclusions 


Enhancements 

■ Inclusion of Wind Models 

■ Hybrid Fleet Mixes 

■ Additional Aircraft Types (e.g, C-130, C-747, etc) 

■ Human Factor Constraints (Crew Rotation) 

■ Navigating around Restricted Airspace 

■ Scheduling: Time of Day Constraints 
Cargo Packing and Loading Scheme 

■ More Complex Routing 

❖ Conclusions 

■ The C-5M platform offers a considerable improvement over the C-5A/B across a 
variety of scenarios and attributes. 

Side by side comparisons, interactive graphs, and multiple perspectives allow real-time 
trade analysis. 

■ Surrogate modeling is a key enabler for dynamic, evidence-based decision making. 


18 


66 










K 

jraoo 

L ,_ „ N\. 

1 

( m a;c ^ W :W W 

M-I«n Tww^fmJi . 1 

nHHte 

i 

99 

1 m m m io:> vt 

— r£3£ -i ; 




-Hii 


ft 

t i.ij-jrj-^ * 

|l| 

C 

1 

ri»e 

" 

' » l>l| tqw 

f~Jfr * » 

■*#* trap ip tap* V Omni 



Thank you! 
Questions? 
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